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Abstract. In this paper, we study the performance of the PCM scheme with linear 
quantization rule for quantizing finite unit-norm tight frame expansions for R d and derive 
the PCM quantization error without the White Noise Hypothesis. We prove that for the 
class of unit norm tight frames derived from uniform frame paths the quantization error 
has an upper bound of 0(8 3 ^ 2 ) regardless of the frame redundancy. This is achieved using 
some of the techniques developed by Guntiirk in his study of Sigma-Delta quantization. 
Using tools of harmonic analysis we show that this upper bound is sharp for d — 2. A 
consequence of this result is that, unlike with Sigma-Delta quantization, the error for PCM 
quantization in general does not diminish to zero as one increases the frame redundancy. 
We extend the result to high dimension and show that the PCM quantization error has 
an upper bound 0(S l - d+1 ^ 2 ) for asymptopitcally equidistributed unit-norm tight frame of 



1. Introduction 

In signal processing, coding and many other practical applications it is important to find 
a suitable representation for a given signal. In general, the first step towards this objective 
is finding an atomic decomposition of the signal using a given set of atoms, or dictionary. 
In this approach, we assume that the signal x is an element of a finite-dimensional Hilbert 
space H = R d and x is represented as a linear combination of {ej} =1 , i.e., 

N 

(1) x = Y, c i e i> 

where Cj are real numbers. In practical application, instead of a true basis, {ej}^ =l is 
chosen to be a frame. Given T = {ej}j =1 , we let F = [e\, . . . , ejy] be the corresponding 
matrix whose columns are {ej}j =1 . We say J 7 is a frame of M. d if the matrix F has rank d. 
The frame T is tight with frame constant A if FF* = XI^. The matrix F T as an operator 
F* : M. d — > M. N is often known as the analysis operator with respect to the frame J 7 , where 
(F*x)j = (x,ej). The adjoint operator given by F : — > M. d , Fy = Y2j=i Vj e j 1S known 
as the synthesis operator with respect to J- . We call the operator S := FF* as the frame 
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operator. Then {S~ 1 ej}jL 1 is called the canonical dual frame of the frame T . It is easy to 
see that for any x G M. d we have the reconstruction formula 

N N 

(2) x = {x, ej) (S^ej) = ^ (x, S^ej) ej. 

3=1 3=1 

If J 7 is a tight frame with frame bound A then clearly S~ 1 ej = X~ 1 ej. In particular, for the 
important case of finite unit-norm tight frames in which ||e 3 -|| = 1 for all j we have A = N/d 
and ([2]) is reduced to 

d N 

x = — (x, Cj) Cj for all x G M d . 
3=1 

In the digital domain the representation must be quantized. In other words, the coef- 
ficients (x,ej) from the analysis operator must be mapped to a discrete set of values A 
called the quantization alphabet. The simplest way for such a mapping is the Pulse Code 
Modulation (PCM) quantization scheme, which has A = <5Z with 5 > and maps a value t 
the value in A that is the closest to t. More precisely, the mapping is done by the function 



Qs(t) := argmin rg ^|t — r\ 



t 1 
5 + 2 



and the quantization function Qs is called the quantizer. Thus in practical applications 
we in fact have only a quantized representation through the quantized analysis operator 
Vj '■= Qs((F*x)j) = Qs((x, ej)), j = 1, . . . ,N for each x S M d . The reconstruction through 
the frame operator yields 

N 

x = ^Q 5 ((x,e i ))(^ 1 e j ) for all x G M. d . 

3=1 

Naturally we may want to ask about the error for this reconstruction. 

An important class of frames is the unit-norm tight frames. This paper shall focus on this 
class of frames, although the questions we raise and the techniques we use can be applied 
to other frames. Let T = {ej}j = i be a unit-norm tight frame in M. d . For each x G M. d we 
have 

d N 

(3) x = — Y^CjCj, where Cj = {x,ej) . 

3=1 

With PCM quantization and quantization alphabet A = b~7L the reconstruction becomes 

d N 

(4) xjr = j^^qjej, where qj = Qs(cj) G A. 

3=1 

Under this quantization we denote the reconstruction error by 

E 5 (x,T) := \\x-x,jr\\ 

where || • || is £2 norm. An important question is how E§(x,J-) behaves for a given frame 
J- and either for a given x or for a given distribution of x. To simplify the problem, the 
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so-called White Noise Hypothesis (WNH) is employed by engineers and mathematicians in 
this area (see HI El [H] ) . The WNH asserts that the quantization error sequence 
{xj — qj}jLi can be modeled as an independent sequence of i.i.d. random variables that 
are uniformly distributed on the interval (—5/2,5/2). With the WNH, one can obtain the 
mean square error 

MSE = £(||*-^|| 2 ) = 

It has been shown that the WNH is asymptotically correct for fine quantizations (i.e. as 
5 tends to 0) under rather general conditions, see 0[TT]. Although the result implies that 
the MSE decreases on the order of 1/N, this is in fact quite misleading because the WNH 
holds only asymptotically when the frame J- (and hence N) is fixed while 5 decreases to 
0, and with a fixed 5 WNH cannot hold whenever N > d [6]. Furthermore, the MSE only 
gives information about the average behavior of quantization errors. There has not been 
an in-depth study on the behavior of the error Eg(x,J-) for a given x and as one fixes 
5. This contrast sharply with the study on the quantization error from the Sigma-Delta 
quantization schemes, where the quantization step 5 is typically assumed to be fixed and 
rather coarse, see e.g. [H[5]. One of the objectives of this paper is to study the behavior of 
E$(x,J-) as we choose different unit-norm tight frames J-. 

It is well known that with the Sigma-Delta quantization schemes the reconstruction error 
will diminish to as we increase the redundancy of the frame T . For unit-norm tight 
frames it means that for fixed 5 by letting N — > oo the reconstruction error tends to 0, 
even when the quantization is coarse in the sense that 5 >> 0. One naturally asks whether 
similar phenomenon also occurs with PCM quantizations, i.e. how much can we mitigate 
the reconstruction error Eg(x,J-) if we increase the redundancy of the frame J 7 , and is it 
possible that by increasing redundancy in a suitable way the reconstruction error E$(x,J-) 
be made arbitrarily small for all xl Clearly if ||x|| < 5/2 then all coefficients are quantized 
to and hence the quantization error is always x. Hence in this case the error does not 
diminish. However, when \\x\\ >> 5 we may expect that the increase redundancy will help 
mitigating the error. 

In this paper we attempt a more in-depth study of the PCM quantization error Eg(x,J-) 
with respect to unit-norm tight frames T. In particular we study the asymptotic behavior 
of E$(x, J-) as we increase the redundancy of the unit-norm tight frame. A surprising result 
(at least to us) is that in general the quantization error E$(x,F) does not diminish to no 
matter how much one increases the redundancy of the frame T . The following example is 
a good illustration. 

Example 1.1. We choose xq = [vr, e] T , 5 = 1/16. Let JF = {ej}j = i be the harmonic frame 
in M 2 given by ej = [cos(^p), sin(^^)] T , j = 0, . . . , N — 1, which is a 2-dimensional unit- 
norm tight frame. Then we compute E$(xq,J-) for N = 10, . . . , 2000 and show the result in 
Figure 1. From the figure one can see that although as we increase N the quantization error 
Eg (xq , J-) decreases initially, it settles down to around positive value no matter how much 
redundancy is increased. Thus PCM quantization fails to take advantage of redundance. 
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Figure 1. The frame expansion of [vr,e] T G M 2 with respect to the frame 
[cos(27rj/iV), sin(2-irj /N)] T are quantized using the PCM scheme with 5 = 
1/16. The figure shows the PCM error against the frame size N. 



Of particular interest to this study is a very popular class of unit-norm tight frames 



known as the harmonic frames. For any N > d the harmonic frame H 
given by 



N\N-1 



IS 




2vrj 2vrj 2vr2j 2vr2j 
cos -TT- ; sin — — , cos — , sin — 

N N ' N N 



2irdj 2irdj 
, cos — — — , sin 



N 



N 



if d = 2d is even or 



1 2nj . 2irj 
-,cos— ,sm — 



2itdj 2ndj 
.cos — ——.sin 



N 



N 



if d = 2d + 1 is odd. Harmonic frames themselves are a special case of unit-norm tight 
frames obtained from uniform frame paths introduced in [2]. Let / : [0,1] — > M. d be a 
continuous function with ||/(t)|| = 1 for all t. It is called a uniform frame path if for any 
N > d the set of vectors {/(^)K1 1 is a unit-norm tight frame in U. d . So the harmonic 
frame is obtained simply by taking iV samples of the frame path 



h(t) 



cos(i), sin(t), cos(2t), sin(2t), . . . , cos(dt), s'm(dt) 
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if d = 2d is even or 



'2 



1 



h(t) = \J — — cos(i), sin(t), cos(2f), sin(2t), . . . , cos(dt) , sin(dt) 
• v2 



T 



if d = 2ci + 1 is odd. We examine the limitations of uniform frame paths in terms of its 
ability to mitigate quantization errors with increasing redundancies. 

Throughout the paper we shall use the notation X <C a & ... Y to refer to the inequality 
X < C • Y , where the constant C may depend on a, b, ... , but no other variable. We now 
state one of our main results in this paper. 

Theorem 1.2. Let f : [0, 1] — > R d be a uniform frame path with bounded f and set 
:= {f(^W~)}f=i- Suppose that x £ W 1 and h{t) := (x, f(t)) is analytic such that all zeros 
ofh"(t) on [0,1] are simple. Then 

E 5 (x,T) «* 

for N < 1/5 2 and 

E s (x,F) J 3 / 2 

forN> 1/S 2 . 

The above theorem shows that liminf^jr^^ Eg(x, F) <^. x 5 3 / 2 for unit- norm tight frames 
obtained through frame paths. The question is whether 0(J 3 / 2 ) is sharp. Our next result 
shows that in KL 2 the bound 0(<5 3//2 ) is sharp for all unit-norm tight frames. As a result 
PCM can only partially take advantage of the redundancies in PCM quantization. We prove 
the result by showing that the average quantization error for any unit-norm tight frame in 
R 2 is bounded from below by <3(<5 3 / 2 ). Set 

/ ,-2-k \ 1/2 

E s (r,F) := I J \E 5 {x^T)\ 2 d^\ , 

where x^ := r[cos tp , sini[)] T and r > 0. Then 

Theorem 1.3. Set R := r/S and e := R + 1/2 - [R + 1/2J . 

(i) Suppose F is an unit-norm tight frame inM 2 . If e = 0, then 

32 5 3 / 2 

(ii) Suppose J- is an unit-norm tight frame in R 2 . There exists a £q > such that for 
e £ [0, £o] an d sufficiently large R we have 

£3/2 

for some fixed constant C > 0. 
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(iii) For the harmonic frame F = {ej}yL 1 with ej = [cos(2jTT / N) , sm(2jir / N)] T , assume 
that r, 5 satisfy 

/IT 
Ag(r cos 8 s ) cos 8d8 = 0, 
-7T 

where A$(t) := t — Q${t). Then 

E 5 (r,F) = 0(±) 
where N = jf F. In particular, r, 5 satisfy |6P if 



_ r V8-2\/l6^^ 
R = ~x = • 

7T 

The above theorem shows that for any 5 > there exists a > such that (rg , F) S> 
<5 3//2 , which implies that the bound 0(<5 3 / 2 ) is sharp. Hence in general PCM quantization 
cannot take full advantage of frame redundancy. However, by (iii) in Theorem II. 31 for each 
r > 0, E$(r, F) tends to at the rate 1/N if J_ Ag(r cos 0) cos 9al9 = 0. The result implies 
that, for each 5 > there are some x in M 2 that can take advantage of frame redundancy. It 
will be an interesting problem to find the sufficient and necessary condition for the validity 
of®. 

An immediate consequence is that the bound 0(5 3//2 ) is sharp for harmonic frames in M d , 
as any harmonic frame in ~R. d has a 2-dimensional harmonic frame imbedded in it, and the 
lower bound applies to this imbedded 2-dimensional harmonic frame. 

Given the limitation of harmonic frames in mitigating PCM quantization errors, one 
naturally asks whether the error bound 0(<5 3 / 2 ) can be improved. It turns out that this 
is possible if we distribute the frame elements more evenly on the unit sphere § rf_1 . A 
sequence of finite sets A n C S rf_1 with cardinality N n = #A n is said to be asymptotically 
equidistributed on § rf_1 if for any piecewise continuous function / on § rf_1 we have 



lim aT E = I f^ du > 



where / are piecewise continuous functions on S d and dv denotes the normalized Lebesgue 
measure on S rf_1 . We have 

Theorem 1.4. Let J~ n be a unit-norm tight frame in~U. d . Assume that T n are asymptotically 
equidistributed on S d_1 . Then for any x G M. d we have 

§(d+l)/2 
lim E s (x,F n ) < d , 

where r = \\x\\ . 

Asymptomatically equidistributed unit-norm tight frames in M. d can be obtained via the 
spherical t-design [10] and other methods. We conjecture that the bound 0(5^ d+1 ^ 2 ) is sharp 
for any unit-norm tight frame in M. d . If the conclusion holds, it implies that asymptotically 
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equidistributed unit-norm tight frames in M. d are optimal unit-norm tight frame for PCM 
quantization. 

The paper is organized as follows. After introducing some preliminaries in Section 2, 
we give an up bound of Eg(x,J-) under the WNH, which is valid with high probability, in 
Section 3. We present the proof of Theorem 11.21 in Section 4. The proof of Theorem 11.31 is 
given in Section 5. We finally give the proof of Theorem 11.41 in Section 6. 



2. Preliminaries 

Hoeffding's inequality jSJ. Let X\, . . . , Xn be independent random variables. Assume 
that for 1 < j < N, ~Pr(Xj — S(Xj) G [oj, bj]) = 1. Then for the sum of variables, 

S = X 1 + • • • + X N 



we have the inequality 

Pt(\S-S(S)\ > t) < 2exp 



2t 2 



which are valid for positive values of t. 

Discrepancy and uniform distribution (see also [8]). Let {uj}j =i be a set of 
points in [—1/2,1/2) identified with the 1-torus T. The discrepancy of {iij}j =1 is defined 
by 



Dise({uj}f =1 ) := sup JcT 



#(K}f =1 n/) 



N 



where the sup is taken over all subarcs / of T. 

We also need the following two well-known results: 

Theorem 2.1. (Koksma's inequality) For any sequence of points u\, . . . ,un in [—1/2, 1/2) 
and any function f : [—1/2, 1/2) — > R of bounded variation, 



(7) 



1 N /-1/2 



< Var(/) • Disc({ % }f =1 ), 



where Var(/) is the total variation of f. 



Theorem 2.2. (Erdds-Turdn inequality ) For any sequence of points U\, . . . , un in [—1/2, 1/2), 
and any positive integer K, 



K 



DisctKllx) « ^ + E^ 

fc=i 



1 N 

-Y 

N 4^ 
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Exponential sums. By Erdos-Turan inequality, to estimate the discrepancy, we need 
to compute the exponential sums 



n 

2nif(m) 



e 

m=l 



where / is a real-valued function. We shall use the truncated Poisson formula and van der 
Corput's Lemma to estimate S. 

Theorem 2.3. (Truncated Poisson formula) Let f be a real-valued function and suppose 
that f is continuous and increasing on [a,b]. Put a = f'(a) and (3 = f'(b). Then 

e 2nif{m) = Yl / e 2m(/(r) " ,;T) dr + 0(log(2 + /3-Q)). 

a<m<b a-l<v<P+l Ja 

Lemma 2.4. (van der Corput) Suppose <f> is real-valued and smooth in the interval (a, 6) 
and that \c/)^(t)\ > jx for all t G (a, b) and for a positive integer r. If r = 1, suppose 
additionally that <p' is monotonic. Then 



e im dt 

where C r is a constant depending on r. 



f 

■J a 



b 



Euler-Maclaurin formula. Suppose 4> is smooth in the interval [a, b], where a and b 
are integers. Then 

J>(j) = f\(x)dx + (0(a) + <X&))/2 + jZ(B 3 /j\) (f-^Xa) - ( ^ 1} (6)) + E p , 

■ n J Ob ■ Q 



j=a " i=1 

where Bj are the Bernoulli numbers and 



1^1 < 



3. The error bound under the WNH 

In this section, given x £ M. d , we derive a bound for Es(x,J-), which is valid with high 
probability, under the WNH. As a conclusion, Es(x,J : ) tends to with probability 1 when 
jfT — > oo under the WNH. Recall that T = {ej}^ =l is a finite tight frame in R d and 
F = [ei, . . . , ejv] be the corresponding matrix whose columns are {ej}^ =l . We define the 
variation of F as 

N-l 

a(F) := mm \\e p(j) - e p{j+1) \\. 

3=1 

Then we have 
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Theorem 3.1. Under the WNH, for each fixed and e G (0, 1/2), we have 

Pr (\\x - x N \\ < jJ^-(a(F) + 1)) > 1 - 27Vexp(-2iV 2£ ). 

Proof. The WNH implies that Xj — qj € [—5/2, 5/2) and £(xj — qj) = 0. To this end, we set 

3 

Uj := y^( x k - Qk), u :=0. 

k=l 

Then, by Hoeffding's inequality, we have 

Pr(|«j| < N l/2+£ 5) > 1 - 2exp(-2iV 1+2 7i) > 1 - 2exp(-2iV 2E ), 
for j = 1, . . . , N. We obtain that 

Pr [ (~){\uj\ < N 1/2+£ 5) ) > (l-2exp(-2iV 2£ )) iV > 1 - 2N exp(-2iV 



2s\ 



K 3=i / 



Noting that 



d N d N 

E 8 (x,T) = jy^ixj - qj )ej = —J2( u 3- u 3-i) e 3 
3=1 j=i 



N 



N N-l 

J=i i=i 



— [ ^ Uj{ej - e j+1 ) + Uivejv ] , 



3=1 



we have 



A . N 1 / 2+6 5 d ■ 5 

Es{x,F) < j^WF) + 1) = j^z-M F ) + !)• 



with probability 1 - 27Vexp(-27V 2E ). □ 

4. The Proof of Theorem 11.21 

Let / : [0,1] — > R rf be a uniform frame path and set T := {ej}^ =l with ej = /(^r)- 
For x G M d , we use {cj}^ 1 to denote the corresponding sequence of frame coefficients with 

respect to J 7 , i.e. Cj = (^x,f(^-)^. Let {qj}^ =1 be the PCM quantize, i.e. qj = Qs{cj). 
The resulting quantized expansion is 

7 AT 

a \ -> at 

3=1 



10 

We set 

Then we have 
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:= ^2(ck ~ Qk), 3 = 1, • • • , N, and u := 0. 



k=l 



X — Xjr 



d N d N 

i=i 

N 



N 
d 



N 



f N-\ 



3=1 

N-l 
3=1 



Jj ( Yl u i( e i ~ e i+i) + UNeN 



.3=1 



which implies that 
(8) 



N-l 



x - xjr\\ = — 1| ^ uj(ej - ej+i) + u N e N \\. 



3=1 



Hence, when working with the approximation error written as (j8]), the main step is to find 
a good estimate for Uj . 

Lemma 4.1. Suppose that there exists an analytic function h such that Cj = h((j — l)/iV) 
where N > d and 1 < j < N. Suppose further that the zeros of h"(t) on [0, 1] are simple. 
Then 

max \uA <a VN log N5 + VN6 + NS 3/2 . 
1<3<N J 

Proof. Set y n := c n — q n and y n := y n /b~ = (c n — q n )/8 wherel < n < N. Recall that we use 
Disc(-) to denote the discrepancy of a sequence. Koksma's inequality implies that 



n=l 



1 3 



rl/2 

/ ydy 



n=l 



1/2 



< j5Bisc({y n y 



n=l) 



Using Erdos-Turan inequality, one has 

for any K £ N, Disc({y n }n=i) < 
Now we need to estimate 

3 

e 2iviky n 

Set 



1_ 1*1 



n=l 



n=l 



(9) 



X N {-) := h(-/N). 
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Then we have 

y n = Xn(ti) modulo [—5/2, 5/2). 

Since h is analytic, the number of zeros of h" on [0, 1] is finite. Let {^}f =1 be the set of 
zeros of h" on [0, 1], and let < a < 1 be a fixed constant to be specified later. Without 
loss of generality, we suppose z t < zt+i,t = 1, . . . , n* — 1. Define the intervals It and Jt by 



for t = 1, . . . , n* , It 
for t = 1, . . . , n* — 1, Jt 



[Nz t -N a , Nz t + N a ], 
[Nz t + N a , Nz t+1 -N a ], 



and 



J = [1, Nzi - N a ] and J n » = [Nz n * +N a ,N]. 

If zi = , we modify I\ as [1, iV a ] and no longer need Jo- Similarly, if z n * = 1, we change 
I n * as [N — N a , N] and remove J n * . Note that 

[1,N] C J U h U Ji U • ■ • U I n * U J n *. 

Since the zeros of /i" on [0,1] is simple, h'"(z t ) / for f = 1, ...,n*. Then, by Taylor 
expansion, we have 

1 N c 



for n G N fl J t 



N l- a 

provided N is large enough, which implies that 

k 

forneNnJ t , 



N 3 ~ a ■ 5 



N 



n 



N- 



k 



K(n) 



for large enough N. Since h! is bounded on [0, 1], by 0, we have 



for n e Nn J t , 



X' N (n) 



k 



N -5 



Note than X' N is a monotonic function in Jj and set 



k k 
a t := min -X' N (n), /3 t := max -X' N (n). 

nennJt 5 neNnJt 5 



Then, a simple observation is that fit — at <Ch i^z- 

Using the truncated Poisson formula and van der Corput's Lemma, we obtain that 



E 



D 2mky„ 



neNnJt 

s E 

ai-l<-u</3 t +l 



2irikX N (n)/S 



E « 

neNnJt 

.,kX N (T) . 

; 27ti( — £ "^dr 



+ 0(log(2 + (3 t - a t )) 



, 2k 

<<h { N5 + 2) 



. f kX N (T) x 



■It 



+ 0(log(2 + — )) 



<* V ^ (1 " Q)/2 + V ^ (3 - a)/2 + 0(log(2 + ^-)). 
V o V k ivo 
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The estimate above is also valid if we restrict n E [1, j], i.e., 

a 2mky n 



E ' 

neNnJ t n[ij] 
We also have the trivial estimate 



E < 

neNn/t 



2niky n 



< 2N C 



Hence, we have 



E' 

n=l 



,2-Trikyn 



«„ 2iV a + J-N^'* + </ V 3 ^ 2 + (log(2 + ^)). 

V o V fc iVo 



Now, we can estimate Disc({y„}^ =1 ) as follows: 



K 



for any if eN, Disc({y n }{ =1 ) < — + — — 

J fc=l 

/ i i 

1 1 

K 

1 1 

K 



ikjjr, 



n=l 



1 / „ [W 1-a [I 3- * I 2fc \ 

+ - (2iV" log*T + 2^ y J\nr + ^-N^~ + 0(g ^ log(2 + — ))J 



We choose K = [VN\ and a = 1/2. Then 
\uj\ < j SBisc({y n y n=1 

< h 4^+ ( v / iVlogAf5 + 2v / M + iV5 3/2 + 0(()dogiVlog(2 + -^)) 



<C 4^= + f V^V log N5 + 2\/M + N5 3/2 ) , 



which follows 



max \v,j\ <€. h VN log N5 + VN6 + NS 3/2 . 
i<i<JV J 



Proof of Theorem[Tj& Set yj := Xj — qj. We consider 



d 



N 



\x — Xn\ 



(10) 



3=1 

d N ~ 1 d 

£ u i( e i ~ e i+i) + u nzn\\ < |u 
i=i 



□ 
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where the last inequality follows by \\ej — ej+i\\ = ||/(^r) — /(jvOII ^ ~k with ||/'|| being 
bounded. Lemma 14 . 1 1 with h(t) = (x,f(t)) implies that 

(11) — max k,- <^ x \ h ' \-8 i/2 . 

N i<j<N l Jl \ N y/N 

A simple observation is that 

(12) HVf^'H < ^ 



JV ' J - ViV 
when N < -h. Combing (jllh and (|12j) . we have 

— max \uj\ < x when N < —r 

N i<j<N J V N 5 2 

which implies that 



8 

\x-xjt\\ « x y — 



provided N < -h. 

We now turn to the case where Af > w. To this end, in the basis of (jllh . we only need 



to prove that 

'S 5logN 



max|J^,^,^ 2 ) < 6^. 
\ \ N \/N J ~ 



Indeed, N > 1/5 2 implies that \ / 4? < <5 3 / 2 . Moreover, we have 



SlogN _ 5 logiV < __6_ < d3/2 



provided N is big enough. The claim follows. □ 

5. The proof of Theorem 11.31 

Throughout the rest of this paper, we set 

A*(t) := t-Q s (t). 

Then we have 

Lemma 5.1. Suppose that r > 0, 5 > 0. Set R := r/8 and e := R + 1/2 - [R + 1/2J . 
(i) If e = 0, then 

16^/2 5 3 / 2 



/7T 
A 5 (r cos 0) cos 0d0. 
-7T 



37T 2 y^T 

(ii) There exists a Eq > suc/i i/iai, w/ien e G [0, £o], 

§ 3/2 r 

Cx—j^ < / A s {r cos 0) cos 0d0, 

provided R is big enough, where C\ is a fixed constant. 
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Proof. We first consider the case with e = 0. Note that 



/7T /"7T 
A s (r cos 0) cos OdO = 2 / A 5 (r cos 0) cos 6>cZ6» 
7T V o 

2 / (r cos - <5LR cos + 1/2J) cos 0d0 
Jo 

/•7T 

- 2<5 / [#cos0 + 1/2J cos0d0 
■/ o 

(13) = 6 (nR- 2 [RcosO + l/2\ cos edO^j . 

If i? = 1/2, then a simple calculation shows that 



= irr 



A s (r cos 0) cos 0<i0 = 7r<5/2 



which implies the conclusion. To this end, we only need investigate the case R G Z>i + 1/2. 
We set L := -R + 1/2 G Z and 17 := R + 1/2 G Z. We now consider 

Li? cos + 1/2J cos 9d9 

'- 1 /•arccos((j-l/2)/fl) 

cos 0eZ0 

j^L Jarccos((i+l/2)/R) 
C/-1 







- ^7 

C/-1 

= £ i( Vi - 0i - m/R) 2 - Vi - 0i + V2)AR) 2 ) 

C/-2 (7-1 

= o + i)Vi - (G + m/R? - E^vi - (v + i/2)/i?)< 
= x; vi - + V2)/i?) 2 = (E v^ 2 - (j + vm/R 

3=L j=L 
R-3/2 

(14) = £ (2 Vi? 2 - (j + 1/2) 2 ) /i?. 

i=o 

Set := arccos((j + 1/2) /R) - arccos((j + S/2)/R). We claim that 

£ 

j=0 



(15) 



^ Li?cos0+-Jcos0 ( i0 = # E Sin ^'+ 2V 1 " 4R 2 ' 
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Indeed, the claim can follow from the following calculation 

R-3/2 

R s m rfj 

R-3/2 



1 E [(j + \)\jR 2 -(3 + \) 2 -(j + \)\jR 2 -{3 + \? 

3=0 V / 

R-5/2 



r i i / r 

/ I cos 6> + -J cosOdO a/1 ; 

Jo 2 J 2V AR- 



AB 2 ' 

where the last equation follows from (|14p . Moreover, by Taylor expansion, we have 

«-3/2 1 vr 1 

£ ^ = arccos(-) < | - — , 

j=0 

which implies that 

R-3/2 

(16) 2R V'i + 1 < 

3=0 

Then, combining (|15p and (|16p . we obtain that 

«-3/ 2 r 1 

(17) 2i? V (ipj - sin ipj)<TrR-2 [R cos + -J cos 9d9 

3=0 Jo 2 

Noting that ipj — sin rpj > 0, we have 

R-3/2 

(18) ^ i^j ~ sm ipj) > iiR-3/2 ~ smVij-3/2 

3=0 

4 ,.3 _ 4 , , n 1/m , 3 



^ 3^2^-3/2 = ^3 (arccos(l - 1/R)) C 



- 3vr 2 ' 



Combining (|T3j) . (fT7j) and (|T8j) . we arrive at 

Ax(r cos 9) cos 



sLrR-2j [Rcose + ^\cos0d0\ 
16V2 8 3 / 2 



3ir 2 %Jr 



16 
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We next consider the case £ / 0. Using the similar method as before, we have 

R-l/2-e 



r 1 1 I — 

J [R cos 9 + -J cos 9d9 = R sin^j_i - - y 1 - 



+(R+i-z)\i 2 4-d) 2 



R y R' 



and 



Then 



7T 



K-l/2-s 

£ 



/o -3/2 i 

i? = 2i? 1 p j _ 1 + 2 V2^R-l + -^ r —^+0(- 



6 #1/2 v #3/2' 



ttR-2 [Rcos9 + 1/2J cos 



B-1/2-B r- 

2i? ^ (^._ 1 _ sin ^._ 1 )_2( J R+l- e ) 1 /^-(l)2 



J=0 



6 JR y R^' 

> 2RU> R _ 3/2 _ 6 - sin^_ 3 /2- £ ) + (^e 3 / 2 - 2(1 - e)V2~e)^= + 0(-i 



(19) 



p^ + ^ 3/2 _ 2(1 _ £) ^ +0( _i 



J_) 



Note that there exists a £o > such that 

(V2T2e-^)3 + 2^ e 3 /2 _ 2(i _ E) ^- 



3 3 
is positive when e 6 [0, eq]> which implies that 



irR-2 [R cos 9 + 1/2J cos 9d9 > 



R 

when R is big enough, where C\ is a positive constant. The conclusion follows. 

Proof of Theorem ] 1.31 We suppose x^ = r[cos r ipQ,sm.ij)Q\ T and T = {e J }^ 1 with ej 
[cos9 j ,sm9 j ] T ,9 j € [0,2vr). Set R:=r/5. Then 

2 " 

E s {x^ ,F) = —\\2^A 5 (rcos(9 j -'tp ))e j \\ 

iV 

|^Ai(i?cos(^-^ ))e i ||. 



JV 1 
25, 



AT 



Let 



P 



(i'o 



cos ipQ sin V'o 
- sin ip cos V'o 
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Then a simple observation is that 



(20) 



2<5 



A' 



E 5 {x^ ,F) = — 1| Ai(22cos(0j - Vo))^o e ill- 



j'=i 



Denote /xjr = X^i ^ wn ere 8q. is the Dirac measure at 9j. Then we can rewrite ([20 



as 



E 8 (x 1 p ,7) = 2S\\(H R *^)( 1 f> )\\, 
where * is the component- wise convolution operator and 



H R (t) := A^Rcost) 



Note that 



V25 



cos t 
— sint 

1/2 



25\\H R * ^|| L2 = ^(V \\H R * M^llY 



/2 



v 7 ^ 



(£ll£*(*)ll 2 IAH*)l 



2x1/2 



fcez 



where || • ||^2 and || • || denote the L 2 norm of vector functions and £ 2 norm of R 2 , respectively. 
Since fij^(0) = 1, it follows that 

V28 



> 



/ IT 

V25 



(||^(0)|| 2 + \\H R {k)\\ 2 \Mk)\ 2 ) 112 
fcez\{o} 

ll^(0)||. 



We still need to estimate H R (0). Note 

r 2n 



Hr(0) 



o 



2tt 



H R {t)dt= I Ai(Rcost) 



cos t 
— sint 



dt 



J * Ai (R cos t) cos tdt 




By (i) in Lemma 15.11 when 5 is small enough, 



p2n -y r2n 16\/2 /(5 

/ Ai (R cos t) cos = — / Ag(r cost) cos tdt > a / — , 

Jo 5 Jo 3vr 2 V r 



which implies that 



E tf (r, J") > 



32 «5 3 / 2 



3vr 5 /2 

Similarly, (ii) can be proved by (ii) in Lemma 15. 11 
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We now turn to (iii). Note that Hr(0) = if 

Aj(rcos0)cos0d0 = 0. 

-7T 

Also, note that 

fe(k) - 

where N = j^J- ' . Hence, 



1, /cmodiV = 0, 
0, fcmodiV^O. 



1/2 



W*iR\Kiv )\\ 2 

fcez\{o} 



According to Riemann-Lebesgue Lemma, 



\\Hr(N)\\=0(±). 

The conclusion follows. 

We now consider (|2ip . A simple calculation shows that 



J A s (r cos 0) cos OdO =<rrr -46 \J 1 



4r 2 

provided r < 6 < 2r. The result implies that 

£*(0) = 

if ^_^^^ = 

r v / 8-2 v / T6^¥5 



i? 



5 IT 



6. The proof of Theorem 11.41 

To prove Theorem 11.41 we first introduce a lemma. 
Lemma 6.1. When d > 2, 



f'TT 

/ A s (rcos8)cos9(sme) d - 2 de 
Jo 



r (d-i)/2" 



□ 



Proof. Similar with Lemma 15.11 we set R := r/5. To state conveniently, we only consider 
the case R + 1/2 G Z. The other case can be proved by a similar method. A simple 
observation is that 



A 5 (r cos 0) cos 0(sin 0) d-2 d0 = 
(22) 5 { R Iq ( cos9 ) 2 ( s[n9 ^ 2d9 ~ J Q [RcosO + ^\ cos 9 {sin 0) d - 2 d9^j . 
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Then, we consider 

f [R cos 6 + h cos 0(sin 9) d - 2 d8 
Jo 2 

R- 1 / 2 /•arccos((j'-l/2)/fi) 

E W cos 6 (sin 6) d - 2 d6 

j = _ R+1 / 2 ^arccos((j+l/2)/_R) 

= E i((l-((i-l/2)/i?) 2 )( d - 1 )/ 2 -(l-((i + l/2)/i?) 2 )( d - 1 V 2 ) 

j=-R+l/2 

R-l/2 

( 23 ) = ^1 E (i - ((i - i/2)/i?) 2 ) (d - 1} 



l)/2 

j=-fl+3/2 

As we shall see later, 

R-l/2 



E (1 - ((J - i/2)/i?) 2 ) (d - 1)/2 

j=-i?+3/2 

(24) = i? [ W {cos9) 2 {sme) d - 2 d9 + Oil/R^- 1 ^ 2 ). 

Jo 



Then combining (|22p . (|23p and (|24p . we reach the conclusion. 
We remain to argue (j24j) . We set 

(d-l)/2 



Then the left side of (|24p equals to J2j=-R+3/2 /u)- R ecan that Euler-Maclaurin formula 
E /C?) = / /(z)cfe+(/(-i2 + 3/2) + /(i2-l/2))/2 

j=-R+3/2 J-R+3/2 



3=2 



where -Bj are the Bernoulli numbers and 



2 /--R-l/2 
E P \ < -— \&\x)\dx. 



(27r)P J- R+3 /2 

Note that 

H-l/2 rR+1/2 i 

f(x)dx= / /(z)dx + 0(- 



fi+3/2 1 ' J-R+l/2 " ' i?( rf_1 )/ 2 
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Let 9 = arccos((2x - l)/2R). We have 
" R+1/2 . . R 

-R+l/2 

where the last equality follows from the integration by parts. Then we arrive at 

'R-l/2 /*7T 1 



[ R+ ' f(x)dx = — ^— [ {sm9) d d9 = R I (cos fl) 2 (sin 6) d - 2 d6, 

J -R+l/2 d — 1 Jq Jq 



J ' f(x)dx = R J\co S #) 2 (sin 9) d ~ 2 d9 + O(^j^). 



Note that 



(25) /(-i? + 3/2) = 1/2) < ' 



R {d-l)/2 



and 

(26) | / 0-i)(_ jR + 3 /2) - /0--D(ij_ 1/2)| «, ^L^, j > 2. 

Hence, to prove (|24[) . we just need estimate the error term in Euler-Maclaurin formula. We 
first consider the case where d — 1 is an even number. We take p = d in Euler-Maclaurin 
formula, and then E p = with /^) = provided j > d. Then (|24p follows when d — 1 is 
even. 

We turn to the case where d — 1 is odd. We consider the jth derivative of /. Recall 
that 9(x) = arccos((2x — 1)/2R) is a function about x. Then, using the new variable 9, 
f(x) = (sin 9) d ~ 1 /(d — 1) and 9'{x) = — l/(i?sin0). A simple calculation shows that 

f(x) = f > (9)9' (x) = -^(sm9) d - 3 cos 9, 

/"(*) = ^((d-3)(sin<- 5 -(d-2)(sin<- 3 ). 

Then, by induction, /( 2jf ) is in the form of 

£ C ktd _ 1 ( S m9) d - 2k - 1 , C M _i€R, 
i<fc<2i 

while is in the form of 

^TT E C'M-i ( sin 0) d ~ 2k ~ 1 cos9, C' kA _ x G R. 

j+l<fe<2j+l 

We take p = (d + 2)/2 in Euler-Maclaurin formula. Then 

2 /•arccos(— l+l/K) ^ ^ 

(27) <<P W^l-l/H) ^B^^W^' 

when p is even. Similar argument also holds when p is odd. Combining ()25|) . (|26p and (|27|) . 
we arrive at (12411. The conclusion follows. □ 
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Proof of Theorem \1.4\ We denote the number of the non-zero entries in x by ||x||o, i.e., 

IMIo := #{j : Xj °}- 
The proof is by induction on \\x\\q. Note that 



lim E s (x,J 7 n ) = lim ||— V] A s (x ■ e,)e 

n— »oo n— >-oo /V„ z — ' 



Jzes d 



3=1 



x ■ z)zeM|. 



We begin with ||x||o = 1. Without loss of generality, we suppose x = [xi, 0, . . . , 0] T E M d and 
consider linin^oo E§(x, T n ). By the sphere coordinate system, each z = [z\, . . . , Zd-i] E S d_1 
can be written in the form of 

[cos #i, sin 0\ cos 02, sin 0\ sin # 2 cos 63, ... , sin#i • • • sin #d-i] T , 

where 9\ E [0, 7r) and #j E [— tt, tt),2 < j < d — 1. To state conveniently, we set 



9 



[0,7r) x [-7r,7r) x ••• x [-vr,vr), £ m (0) :=TT sin % 



d-2 



and 

Noting that 

did = Jd 

we have 



J d {6) := |(sin^) d - 2 (sin^) d - 3 ---(sin^ 2 ) 
• • • d9d-i and / Ag(xxZx)zjdu) = 0, 2 < j < d — 1, 



lim E$(x, Tn) = d || / A^(x • z)zdui\ 



A5(xizi)zida; 



A 5 (xi cos^Ocose^sin^O^-^sin^)^ 3 • • • (sin0 d _ 2 )|d0i • • • d6 d -i 

'see 

«, ^ +1 )/ 2 /ki| (d ~ 1)/2 

where the last inequality follows from Lemma 16.11 

For the induction step, we suppose that the conclusion holds for the case where ||x||o < k. 
We now consider ||x||o < k + 1. Without loss of generality, we suppose x is in the form of 
[0, . . . , 0, Xd-k+i, • • • j Xd] £ We can write [xd-\,Xd] in the form of (r cos ifo, r sin</> ), 
where ro £ R+ and <£>o £ [0, 2ir). Then 

d-2 

x-z= ^ x m S m (6) cos6 m + r sin 6»i • • • sin0 d _ 2 cos(0 d _i - ip ) =: T(tp ). 

m=d—k+l 
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A simple observation is 



/ AsiT^Sa^Jdie) cos e^de) + ( f A s (T( l p ))s d _ 2 (e)Jd(e)sme d - 1 de 

Jeee J \Jeee 

= ([ A s (T(0))S d -2(e)Jd(9)cos9d-id9] + ([ A*(T(O))S d _ 2 (0) J d (9) sm9 d 



2 



Then we have 



lim Es(x,J 7 n ) = d\\ / Ag(x ■ z)zdw\\ 

d( V (/ A s (T^o))S m -i(9)J d (9)co S 9 m d9) 2 + (f A s (T( l p ))S d -i(9)J d (9)d9) 



= df V (/ A 5 (T(0))S m - 1 (9)J d (9)cos9 m d9) 2 + (f A s (T(0))S d - 1 (9)J d (9)d9) 

\m=d-k+l Jd ^ h ^ 
< d ^+l)/2/ r (rf-l)/2 

where the last inequality follows from the fact ||x||o < k provided ipo = 0. 



□ 
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